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THE UTILIZATION OF SOCIOLOGICAL IDEAS 
IN ORGANIZATIONAL PLANNING 
A CASE STUDY 
by 

Caroline Hodges Persell 
New York University 

Chapter 1 INTRODUCTION 
Few sociologists have addressed the problem of how sociology is utilized 
in policy formulation. One problem studying utilization is specifying how 
sociology is used. This includes both the form of sociological contributions, 
e.g., concepts versus empirical data, and the role of the sociologist In 
policy-making. What happens when sociological concepts or data are introduced 
as relevant to a problem? Are there intellectual as well as social and 
political factors which determine the extent of their use? 

One way of gaining insights into these problems is by doing qualitative 
case studies of instances in which social science was or was not utilized 
by policy-makers. This monograph represents one such case study. The 
organization studied is the American Educational Research Association (AERA) . 
The events comprising the case run from I966 through 1?73.- All relate to AERA's 
position within the field of educational research, especially the problem of 
how the association could make an impact on educational research policies 
and practice. The study traces the influence of social science on problem- 
formulation, deliberation and decision-making 



I am Indebted to Joan Nacarano for her research assistance in connection 
with this report. The comments of Paul F. Lazarsfeld on earlier drafts of this 
monograph have been most helpful. 
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A. The AERA 

The American Educational Research Association describes itself as 

a professional scientific organization of behavioral scientists 
educators, and those who support the development, application ' 
and improvement of educational research. Among its members ' 
are university professors and deans, directors of research 
and other administrators in state and local school systems, 
research specialists in all phases of education including the 
federal government, graduate students, dnd educators in other 
countries. 

Its objectives are to encourage and improve -educational research 

and Its application, thereby increasing the contribution of education 

to human welfare. (Annual Report, 1968, 1969.) 

At the time of this case study, AERA had about 6000 members. 
Two thirds of AERA members were employed by colleges or universities, 
13 percent were in public, private. or parochial schools, and the 
remaining members worked in government or private agencies or firms. Thirty- 
six percent described their "present major position" as teacher, 2A percent 
as administrator or supervisor, and 22 percent as researcher. The remaining 
18 percent were students, curriculum specialists, counselors or psychologists 
or held other positions. Although AERA's statement names behavioral scientists 
first, 71 percent of members indicate they obtained their highest degree 
in education, 19 percent earned it in psychology, and 3 percent in soma 
other behavioral science (sociology or political science), the remainder 
obtaining their highest degrees in other fields (humanities,, natural 
science, etc.). When this case study began, there were six divisions of AERA: 
Administration, Curriculum and Objectives, Instruction and Learning, Measurement 
Research Methodology. Student Development and Personnel Services, and History 
and Historiography. Before the study ended another division had been formed, 
that of the Social Context of Education, which was designed to include the 
social scientists. The largest divisions were Instruction and Measurement. ' 
One other characteristic of-AERA members is worth noting, and that is 
their relative youth. As of 1970, 68 percent had received their latest 
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degree In 1960-1969 ano 20 percent more obtained their degrees in the previous 
decade, 1950-1959. Thus, AERA is primarily an association of recent degree 
holders. 
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B. The Concerns of the Assoc t at fon 

When Richard Oershlmer became the Executive Officer of the AERA 
in 1964, he recalls having two specific concerns. First, since his own 
training was in educational administration, he wanted to learn more about 
the field of educational research. Including who the "statesmen" were, 
and what were the major concerns of the field. Second, be began puzzling 
over such questions as, "What is It that a community of scholars does?", "Why 
do they form an association?" 

In the first couple years Dershimer was at AERA, a planning committee 
under the chairmanship of Ralph Tyler was discussing the association's 
future. The Tyler committee articulated a policy that AERA should set out 
to build a more interdisciplinary association of educational researchers. 
During the time that the Tyler cormiittee was meeting, Dershimer recalls 
reading such sociology of science books as The Scientific Community by 
Warren 0. Kagstrom (New York: Basic Books, 1965) and Bernard Barber and 
Walter Hirsch^s in the Sociology of Science (New York: Free Press, 1962), 
which included some of Robert Mertor.'s writings. Dershimer raised some 
questions with the Tyler committee about the relevance of those ideas for 
AERA, but they were not developed by the committee. 

Despite this, Dershimer reports that he "had a strong intuition that 
there was something in the sociology of science that was applicable to AERA, 
and that they should try to consider 'it further." (R.D. interview, Oct. 16, 1973), 
He talked his ideas over with Henry Reiken (then at the Social Science Research 
Council) who, while he was skeptical that associations had done anything to 
help develop the state of knowledge in any field of science, neverthg^ss 
encouraged Dershimer to pursue his exploration of insights the sociology of 
science might provide for the improvement of AERA and educational research 
general ly. 

10 
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Another problem began to concern Dershimer, that AERA's relative 
Influence within educational research and beyond. During his first year as 
Executive Officer, the National Academy of Education (NAE) was formed. 
Only one third of the NAE belonged to AERA, and that baffled Dershimer, 
and indicated to him that the Influence and scope of AERA was not what It 
might be. Specifically, it became more apparent that all educational research 
was not being done by AERA members. Further much of the '^outstandi ng'' 
research was independent of AERA. Thus, not only was AERA falling to be 
inclusive , (including all relevant educational researchers) It was also 
failing to be exclusive (i.e., including the more outstanding researchers). 

Finally, between and I967 Dershimer began to feel that the 

professional association was increasingly "impotent**^ with respect to influencing 
the development of educational research. As he perceived It, *'educat iona I 
research is shaped by what the federal government is willing to fund,"- 
and "AERA needs to help define the field. """^ 

In short, Dershimer was trying to get a grasp of the field of educational 
research, to gain more understanding of what a professional association 
could do, and determine how AERA might enhance its influence within and 
beyond educational research. 

The translation of these concerns into a plan of action began in late 
1966, as a result pf discussions between Dershimer and John Qoodlad, incoming 
AERA president. Dershimer had formulated an idea for an AERA Colloquiumj 
which he^defined as "a discuss ion , among equals, of questions of mutual 

*The term used by the executive officer in a phone conversation with 
me early in 1968. 

'^Dershimer Interview, July 5, 1968. 

'f-Dershimer interview, October 16, 1973 
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Interest.^an open discussion but focussed and structured by the papers 
present.'** Goodlad encouraged him to pursue the idea; in fact. Goodlad 
hoped to combine the Idea of a Col loqulum with another long-range planning 
committee, as the Tyler committee had completed its work. Goodlad knew 
that the Tyler committee had recommended a break from the NAE, and was 
concerned with the directions in which he as president should move the 
organization. Goodlad saw the new Planning Committee as doing a study of 
future actions and directions with the Colloquium serving as a kick-off 
conference for the study, according to Oershimer (Oct. 16, 1973 interview). 
From this first conversation. Dershimer and Goodlad envisioned three groups 
attending the Colloquium: 1) people studying social systems among scientists. 
Including communications researchers who were studying fields of scholarship. 
2) leaders In the field of educational research, and 3) AERA leaders, most 
of whom would be on the Planning Committee. 

After the plan was approved by the AERA Council (its governing 
body), the AERA President and Council appointed the Planning Committee. 
Dershimer, in turn, commissioned the papers for the Colloquium (how 
Dershimer commissioned the papers and the nature of those papers will be 
described in detail in Chapter 2) and invited policy-makers In organizations 
similar to AERA to attend the Colloquium. Having received the papers, the. 
experts. AERA Planning Committee members and the* authors of the papers met In 
November. I968 for a two day Colloquium "to examine the findings of the 
studies, to pinpoint the critical problems In the field, and to make 
recommendations to the long-range planning committee of AERA.""-^ 



^Dershimer interview, October 16. 1973, 

and So.- '^^T'^'° Educational Research Ccmmunity: Its Communication 

and Social Structure" Washington: AERA. 1970, pacie ii. 

12 
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After the Conoquium, the Planning Committee met and formulated its policy 
recommendations for the AERA Council (presented in their Planning Report). 
The dbove sequence of events is depicted in Figure I. The executive officer 
was clearly a moving force, both in terms of defining the "problem" of 
AERA and educational research generally as well as in terms of initiating 
the Colloquium and the papers. He was also the primary spokesman for the 
Planning Committee i^ecommendat ions at the Council meeting. 
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Figure 1 



Sequence of Events 



Executive Officer 
Concerned (196^-66) 



Research Papers 
(1967-68) 




AERA President 
(1966). 



Col loquium (Nov. 1968T 



\1/ 



Planning Committee 
Report, (Spring 1969) 



L AEKA Counct I 



Council Meeting, (Fall I969)| 
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Chapter 2 
DATA AND PRINCIPAL AGENTS 
This chapter describes how Dershimer commissioned the Colloquium 
papers, the nature of those papers, the other documents and data used 
In this case study, and the interplay of the agents during the events analysed. 

A. Commissioning the Colloquium Paper s 

Dershimer had "pretty much of a free hand to plan the Co.*uq .un, 
and neither the Council nor the Planning Committee was Involved In ^.ommi ss loni ng 
the studies." (Oct. 16, 1973 interview). He got his ideas about whom to 
invite from other people he knew. For example, Dershimer knew William 
Garvey since he had worked down the street at the American Psychological 
Association (APA) , and knew he was doing communication studies. He went to 
see Garvey at Johns Hopkins and asked him to work with AERA if NSF funded 
the project. Garvey said he would work with them whether or not AERA*s 
proposal to NSF for the Colloquium was funded. Through personal contacts 
and mutual Interests, Dershimer formed his roster of Colloquium paper- 
writers. Dershimer described the assembling of the Colloquium as a ''process 
of accretion.'' When asked what "charge, directions, or questions" he put 
to the paper writers, Dershimer replied that he did not give them directions 
about their papers; he as much as told them, "Do your thing." (Oct. 16, 1973 
interview). It may be that because Dershimer had found his own reading In 
the sociology of science though-provoking, he felt that whatever the social 
scientists might write would be in some way useful to the AERA Planning 
Committee. It should be stressed that, while Dershimer generally knew what 
the authors were doing, (each sent a brief abstract) he had In no sense 
"commissioned" them to consider. a particular problem. 

B . Nature of the Papers 

We can-characterize the papers in terms of the major substantive 
questions they addressed and with regard to whether they were theoretical or . 
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empirical, 

!• William D, Garvey, Cannot Nelson and Nan Lin wrote a heavily 
empirical 32 page paper entitled "A Preliminary Description of Scientific Information 
Exchange in Educational Research/' that dealt with various communication 
processes within AERA, compared with eight other professional societies. They 
surveyed paper-givers and attenders of the prior year's AERA annual meeting 
and also analyzed publication processes and frmn sequences. Twelve of the 
32 pages were tables and figures, and the , 0 pages were filled 

with percentages, means, and other empirica» .ugs. Thus, this paper 

was very heavi ly packed with new data that the authors had collected. The 
paper was mailed in advance to Colloquium participants, 

2. William Paisley wrote a 28 page conceptual paper, enti tled""The 
Role of Invisible Colleges." The paper addressed itself to the communications 
problems of scientific fields by discussing three major concepts: 1) a 
view of the researcher as being at the center of cultural, political, and 
social systems; 2) the notion of "horizontal" and "vertical" knowledge 
transfer in a field, and 3) the concept of "invisible colleges" In fields. 
These related to a series of policy issues in educational research. His 
paper was mailed to Colloquium participants prior to the Colloquium. 5^ 



'^David Lingwood, one of Paisley's students, wrote an empirical paper, 
"Interpersonal Communication,. Scientific Productivity, and Invisible Colleges' 
for the Colloquium. At the opening of the Colloquium he announced that his 
"presentation was completely in error," (Colloquium transcript, page 3) and 
he handed out a replacement for his last table. However, the paper was not 
discussed at the Colloquium, nor will I discuss It here. 
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3. As part of the USOE grant that AERA has applied for and received 

to fund the Colloquium, Dershimer asked Ronald G. Corwin and Maynard 

Selder to conduct a series of lengthy interviews with sociologists of 

science. The sociologists of science were '*told that the purpose of the 

Interviews was to obtain their assistance in placing the immediate problems 

of educational research into a broader, theoretical context/* (Corwin paper, 

page 1). Corwin and Seider report that they 

indicated that the overall objective ^ the project was to 
improve the communication > echanisms used by researcli^ers 

to ^'/lable them to better substantive direction and 

methodologies of the people from various disciplines working 
in the field. It was noted that although some of the problems 
outlined were unique in certain respects, perhaps similar 
problems had been witnessed in other fields of scientific research 
which might be used as parallels. (Corwin and Seider paper, page 1.) 

Corwin and Seider wrote up their analyses of these interviews in a 56 page 

paper entitled, "Patterns of Educational Research: Reflections on some General 

Issues." This paper was organized around the major themes of the structure 

of the field, the quality of educational research, the • i nf 1 uence of emine • 

social scientists on the development of research fields, the relationship 

between basic and applied science, and control over research policy. Thev 

also wrote a 27 page "Overview of Patterns of Educational Research'" cont^ iintg 

some of the highlights of their longer paper. The overview was mailed in 

advance to Colloquium participants. The longer paper was distributed at 

s 

the beginning of the Colloquium, 



-kit 

After the NSF proposal was net funded. 

Th^ Strategy for ttn-at tudy was initially d2.v.eloped by Sam D. Si?efcer 
3n<f tnyself when we were at the ^^re^xx of Applied Social Research, Columbia 
ufer.i'versi ty. When Sieber found ZTcatrrhe had to be out of the country for a year 
r*^ sttudy was conducted by Corw.rr. end Seider. 

For further work of Corvi 's in this area, see Corwin and Saad Z. NagI, "The 
Case of Educational Research", chapter 12 of Nagi and Corwin (eds.). The Social 
Contexts of Research , New York: Wi ley-lnterscience, 1972. 
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I Warren 0. Hagstrom prepared a 19 page paper entitled, ''Educational 

Researchers, Social Scientists, and School Professionals." His paper was 
based on secondary analysis of data from Ralph E, Dunham, et.aK, Teaching 
Faculty in Universities and Four-Year Colleges; Spring I963 (Washington: 
U.S. Office of Education, OE 53022-63, 1966), In his paper Hagstrom considered 
some of the differences between social scientists and educational researchers, 
specifically In terms of their social backgrounds, university activities, 
typical relationships to practitioners and their Ideological stances. He 
discussed how these differences inhibit the flow o^ »deas and people between 
the fields and reduce the chance of cooperation between them. Finally, he 
pointed out some of the dilemmas leaders of scientific societies must face 
if they act to Improve the situation. The six dilemmas he noted were: 

1) boundary maintenance: inclusive :Dr exclusive? 

2) internal differentiation: disc pKnrres or problems? 

3) getting social scientists invc /ed iir educational research: 
immigrants or home-grown producrsT 

A) images of the practitioner: prccoact -staller or product Innovator? 

5) making decisions about the alcrn^srHon (cf research funds: disciplinary 
panels or ;n^ctitioner power? 

6) social crf.trbcism or i nst 1 tut ic- ^a!l die^'e^se? 

Hagstrom read his paper to the Col loquium c.,art:i cr pants on tte first day 
because it was not distributed in advance 

5. Norman W, Storer wrote a 29 pace :;onv^Tiptua 1 paper, entitled 
"The Organization and Differentiation of rne ^lertiflc Community: Basic 
Disciplines, Applied Research, and Conjunc: i Dora! ns , " In 1 1 he developed 
a general picture of the social enterprise th;at » science. Including Its 
epistemologi cal status and its organizationnl structures, with a discussion 
of how the reward system functions. Then he 'ef ned "conjunctive domains," 
i.e., groupings of research according to their r-eievance to broad social 
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concerns, giving medical, agricultural and educational research as examples 
of conjunctive domains. Finally, he discussed what he saw as the most 
appropriate and effective modes of relating basic and applied interests 
within conjunctive domains, bearing in mind the relative hardness or softness 
of those fields and their implications for social organization. (Storer 
paper, page 1.) Storer's paper was distributed in advance to Colloquium 
participants. 

It is possible to classify these papers according to their primary 
substance (based on content analysis) and their theoretical or empirical 
nature (Figure 2). By doing this, one major feature of the papers becomes 
apparent. There are only two empirical papers, Garvey's and, to some degree, 
Hagstrom's. When asked about this (Oct. 16, I973 interview)v Dershimer indicated 
that he was willing to take a theoretical paper and trranslate It into policy. 
But, as shown in the analysis in Chapter 3, the Planning Committee seems 
to have been more impressed and influenced by data, in most Instances, than 
they were by theory. 

C . Other Data 

Five other sources of data were used in this case study: ^ verbatim 
transcript of the Colloquium, the Planning Committee's written report, 
interviews with Planning Committee members, conversations and interviews 
with the AERA executive officer, and observations of the 1969 AERA 
Council and Executive Board meetings. Each of these is briefly described below. 

'slightly edited versions of the Garvey, Paisley, Convin, Hagstrom 
and Storer papers were photo-offset and distributed byAERA in a volume entitled, 
*'The Educational Research Community: its Communication and Social Structure," 
Washington, DC: American Educational Research Association, April, 1970. 
Abbreviated versions of Paisley's and Storer's papers have appeared in the 
Educational Researcher , a bi-monthly publication of AERA. 

19 
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Figure 2 

Classification of Colloquium Papers 
By Substance and Type 



Major Substantive Issues 

Addressed in Papers; Type of Paper 





THEORETICAL 


EMPIRICAL 


rrtftwrii in 1 ^at* ir\n Qv/c t*AfTi 
wLllliinuri 1 L 1 L/ll Ojs Lcni 


ra 1 s 1 ey 


Garvey, Nelson 
and Lin 


Reward System 


Store r 
Hagstrom • 




Quality of Research 


Corwi n 




''Political" Influence 
of AERA 


Corwin 




Nature pf Educational 
Res ea r cti Commun i ty 


Corwin 


(Hagstrom) 



J. 

Some empirical material, but seconda-y, not collected specifically 
for the problems AERA faced. 
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1, Verbatim Transcript of the Colloquium 

This 333 page typewritten document Is a transcription of the Colloquium 
produced by the Alderson Reporting Company. The record includes asides, 
interruptions, and parenthetical comments, e.g., laughter. Everyone's 
remarks are identified t>y name. 

2. The Long-Range Planning Committee Repoj^t^ 

This document \s a 2U page typed report. It is titled: 



irc;c::!jns fur the Am'^erican Educational Research 
Association: Report of the Lom.g-Range Planning 
Commi ttee (Draft) ' 

The fact that th's report is labeled 'iDraft"" and thm it has the 
appearance of a draft, albeit a neat one, had severn^l consequences. First, 
I kept trying to get the "final <^ersion," which do^n ' t exist. Second, the 
AERA Council, which had to act on this report, was very hesitant to do so, 
because they did not consider it to be a final version, and they did not 
want to take definitive action on a draft. Finall-'. we may speculate that 
the Planning Committee may have felt better about making recommendations in 
a "draft" form than in a final form. 
3. Interviews with AERA Planning Committee Members 

These Interviews were conducted by me at the February, 1970 AERA 
Annual Meeting in Minneapolis, Minnesota or by telephone during that same 
month. 1 had a series of openendad questions which I asked everyone 
(See Appendix- for a copy of my interview outline). I encouraged full discussion 
and free association on their part, and took abbreviated verbatim written 
notes on their -replies. • interviewed all the committee members except the 



*lt appears to me that this r-nort remained in Mdraft" form for two 
reasons Firsts the Planning Commi t1tee chairman seems to have run out of time 
that he"could devote to AERA business. Second, as far as he was concerned, 
te report ws finished, but since the Commi ttee had V 
it as final, and since they had no further meetings scheduled in which they 
could approve it. he did not want to declare it a flna^ report h.msel.. 
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chairman, John Goodland, who was out of the country at the t?me, and E.Z, 
Rothkopt, who said he did not attend the Colloquium or the Planning Meetings, 
^. Personal Conversations with the Executive Off i cer (Pershimer of AERA) 

These Colloquium-related conversations began in February I968, when 
Dershlmer called Sam Sieber and me about his proposal for the C. loqulum, and 
have -or inueH until the present. He gave me permission to use freely all 
Lije documentary, Interview, and observational data I gathered, 
5. Observations of I969 AERA Executive Board and Council Meetings 

I sat ir cm the I969 Executive and Council Meetings of AERA as p=rt 
of an evaluation for USOE on the impact of the Colloquium on AERA policy- 
making. During-mose meetings, I taped the proceedings, with the participants* 
permission, and rrren had a typed transcript of the tapes prepared. This 
information hearzz principally on the decision to implement policy 
recommendations Trade by the Planning Committee. Implementation is discussed 
briefly in Chapt^- ^ of this report. 

Interplay of Principal Agents at the Colloquium 

The principal agents at the Colloquium are depicted in Figure 3, 
There are five major groups: the executive officer (Dershimer), the paper- 
givers, the invited experts who were not presenting papers, AERA Planning 
Committee members, and other AERA members. Dershimer had invited the paper 
givers and experts; the AERA Council and president had appointed the AERA 
representatives. 

Two aspects of the verbal exchange are relevant: the relative 
frequency with which each group spoke and the direction of the exchanges * 
between groups . 

The paper authors spoke the most frequent Iv, follov/ed by the experts, 
with the AERA Planring Committee and Council members generally saying the 
least. There are 2t least two possible interpretations of t^is observation. 

First, the paper-givers may have spoken the most frequently because they 

2.2 
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saw that as their role In the Colloquium, with the "experts** perceiving their 
role as commentators, and the AERA participantr the;r role as 

listeners. It Is also possible that the AER^» ; :« ^^n-s may have said 
little because they felt alienated from the Colloquium. It is difficult 
to support one rather than the other of these interpretations on the basis of 
the Colloquium transcript. However, in my interview with one of the Planning 
Committee members, he indicated that the Colloquium was "not relevant 
enough to the concerns of the Planning Committee.'* He thought It was "kind 
of a forced marriage.'* Perhaps this member may have said less because 
he felt uninvolved: but no other Planning Committee members indicated such 
a negative reaction to the Colloquium to me. Therefore, the reason for the 
less frequent participation by AERA members of the Colloquium is still unclear. 

Not only did the paper-givers speak more frequently, but they initiated 
much of the discussion (within the general outline of the questions raised by 
Dershimer at the Colloquium). Their initiation is reflected in the uni- 
directional arrows In Figure 3. 

The major exceptions to both frequency and direction of participation 
were Btdwell and Marcson. I think it Is significant that both are trained 
and practicing sociologists. Thus, they were familiar with the concepts 
and the type of data presented by the paper-givers. They were the two 
indivi dual s'^'among the experts and the Planning Committee who most frequently 
exchanged substantive comments with the paper-givers, as revealed in the 
Colloquium transcript. They much more frequently contilkcted discussions 
with paper-givers than did other members of the group. This interchange Is 
reflected in the double-headed arrov/s between Bidwell and the paper-givers 
and between Marcson and the paper-givers in Figure 3- 
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Observing al] the arrows ti'^at impinge on the Planning Committee in 
Figure 3 suggest';, chat the focus of the Colloquium was influenced more by 
the concerns of the paper-givers and the experts than by AERA participants. 
Aside from how they perceived their roles in the Colloquium, it may have 
been easier for the "visitors'* to speak frequently because they did 
not have any policy investment in- the AERA. The lack of policy investment 
may also explain why there was.no author at the Colloquium who took a 
strong advocate role and very strongly urged AERA to adopt a particular 
course of action. 

One strong change in direction occurred in the Colloquium at 
Dershlmer's initiative. He had planned that three fourths of the two day 
Col loqulum would be relatively unstructured discussion flowing from the papers 
presented, with the last half day devoted to the consideration of some 
^'concrete alternative" models of ways in which AERA might develop. 
(Colloquium transcript, page 269.) He deliberately did not circulate those 
alternatives ahead of time to Colloquium participants, feeling that he 
did not want to pre-s tructure their discussion too much at the outset. Also, 
he wanted to be able to draw on the papers as he formulated the al ternatives , 
and the papers were available only a week or two prior to the Colloquium. 

Ironically, by the time the Colloquium discussion turned most 
specifically to directions and actions AERA might take, the AERA President 
and Planning Committee members had already left to catch their planes. 

The above interplay among the principal agents at the Colloquium 
may well have had consequences for how social science was and was not 
used subsequently by the Plannirvg Committee. It Is to a consideration of 
this Issue that we now turn. 
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Figure 3 



Map of Principal Agents at Colloquium 



Paper Givers 

Storer 
Hagstrom 
Corwin 
Pais ley 
Garvey 



Executive Officer 



AERA Planning Committee 



Good lad (Cha I rman) 

Bidwellf 

Gage 

McLean 

Schutz 

Smith 




Experts 

prlarcsonl 
Burch inal 
David 
Lumsdaine 
Mayor 
Mays 
Norr is 
Walz 



Other AERA Members 



Travers 
Parsons 
Krathwohl 



25 

o 

ERIC 



Page 20 

^ Chapter 3 

ANALYSIS OF HOW SOCIOLOGY WAS UTILIZED BY THE PLANNING 
COMMITTEE IN MAKING POLICY RECOMMENDATIONS 

Thfs chapter describes and analyzes how social science was used 
by the AERA planners as they formulated recommendations about several 
key problems faced by the association. The term the ut; 1 izatlon of 
sociology here refers to three different forms this utilization may have 
taken. First, sociological theory or conceptual orientations may have 
been brought to bear on a policy problem. Second, empi rical data 
collected with social science techniques may have been used by policy 
makers. Finally, in some Instances sociologi sts acted as policy makers. 
These three forms of sociological ''influence" on policy should be kept 
distinct conceptually, even if they are not always distinct In practice. 
As I prodeed, I will try to specify how these three forms of sociological 
Input were manifest in policy recommendations. 

Figure 2 in the last chapter showed a number of the major substantive 
Issues treated in the papers prepared for the Colloquium. Figure h organizes 
these issues into an analytic framework which makes explicit the implied 
relationships among the concepts. Discussion will focus on the four problems 
below the broken line in Figure since they were considered in the papers, 
the Colloquium discussion and addressed in Planning Committee recommendations. 
The nature of the educational research community was examined In several 
papers, discussed at the Colloquium, and considered a great length by a sub- 
correnittee of the Planning Committee (reported in my 1970 interview with a 
Planning Committee member). 
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Figure k 

Assumed Relationships Among Concepts Examined Jn Colloquium Papers 

Nature of the Cormunity 
Activities and Structure of AERA 



Reward System 



Communication System 

~7 — ~~ 



Qual i ty of 
Educat ional Research 



(Pol i tical) Influence 
of AERA 




However, because the Planning Committee could not resolve a number of key 
questions (such as who are developers, and what they do) they did not make 
any reconimendat ions directly treating that subject. Therefore, we will not 
consider it here. 

The analysis of how social science was utilized by AERA policy-makers 
is organized around the problems of 1) the reward 'sys tem of a field, 2) the 
communication system of a field, 3) the quality of research In the field, and 
k) the Influence of a professional association on its field and on the 
principal outside agents that influence that field. 
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A. The Reward System 

The nature of the reward system (RS) in a scientific field and its 

Importance for stimulating quality research was a recurrent theme in the 

papers and In the Colloquium. For example, the importance of the reward 

system is emphasized in Hagstrom's paper: 

Related... is control over symbolic rewards. Election to 
high office and the award of a prize fqr excel lent research 
signifies not only appreciation for the work of an individual 
but confers importance on the kind of work he does. (Hagstrom 
paper, p. 10.) 

Hagstrom's statement begins to specify how sociologists see the reward system 

as furthering good research. Specifically, symbolic rewards serve to hold 

up some research as exemplary, while ignoring other work. 

Storer's paper presents further specification of how^sociologlsts 

see rofards operating to enhance quality research, Storer notes: 

Why the scientist should want professional recognition Is a 

question that has not been fully resolved. There are two major 

hypotheses at .present which attempt to explain this. First, 

there is the proposal that the scientist is trained to want recognition 

because It certifies that he has satisfied the demanding 

requirements of his role: he has advanced our knowledge of some 

aspect of reality. A complementary hypothesis, thus far 

espoused only by myself so far as I know, contends that the desire 

to create, to produce 'meaningful novelty,' is a basic human 

need and that the act of creation is not complete without the receipt 

of competent response to it from others. (Storer paper, p. 7.) 

Either of these interpretations could provide the basis for Corwin's 

assertion about the importance of the reward system for social control in 

science: 

Social control in pure science rests upon the 
exchange of new scientific information for 
recognition (Corwin paper, p. ^2). 



*The Importance of an effective reward system was mentioned at least 
eight times in the research papers and on at least eleven separate occasions 
during the Colloquium. 
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Corwin's statement is predicated on the assumption that researchers do 

seek recofnttion, either for one of the reasons noted by Storer or for 

some other reason. Therefore, it is the desire for recogn i tlon . that fuels 

the scientific drive to contribute new information. The possibility of social 

control arises because recognition can be given or witheld, thereby 

presumably affecting a researcher's desire to do further work. The importance 

for a professional association like AERA, as Corwin notes, 

depends upon whether or not the association has been 
able to provide a substitute reward system. (Corwin 
paper, p. ^2.) 

This observation is important to AERA for two reasons. First, if AERA 
could not provide a substitute reward system, researchers, particularly 
In the behavioral sciences (whom AERA especially wanted to recruit), would 
be unlikely to join the association. Second, if a substitute reward system 
were not working, then recognition, or the lack of it, through AERA could 
do nothing to change the researchers' motivation. Hence, the basic payoff 
of the reward system (of encouraging good researchers and discouraging poor 
ones) would be lost. 

Later in his paper Corwin discusses another aspect of the reward 

system: 

Whether or not a social scientist wishes to Join a professional 
association identified with a particular field of research 
depends upon whether the association is -somehow linked to the professi 
association representing the researcher's primary discipline. 
(Corwin paper, p. ^2.) 

This clearly indicates the importance of rewards for not Just the field of 

educational research but for AERA as well. One of AERA's concerns (mentioned 

In both the Col loquium and the Planning Report) was recruiting behavioral 

scientists who were doing research on education, with the thought being that 

they would raise the quality of research in education and (at least indirectly) 

increase the political Influence of AERA. 
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This point by Corwin, in conjunction wit-i the others above, gives 
a strong conceptual and empirical rationale for why the Planning ConroJttee 
should consider (a) the operation of the RS and (b) how a professional 
association 1 ike AERA might influence Its operation. I stress this because 
I think In this Instance sociology served to introduce a relatively new 
concept to some members of the Planning Committee, 

At the Colloquium most of the discussion focused on the various 
types of rewards that do or could exist and upon the question of whether or 
not the reward system can be manipulated by a professional association. 
These two issues suggest that the speakers had already agreed upon the importance 
of the concept. It remained for the policy makers to decide whether the 
association can manipulate the system, and if so, how they can do so with" 
the fewest negative consequences. 

The papers and Colloquium considered the question of the various 

kinds of rewards that were or could be operating in educational research in 

addition to professional recognition, in reporting on his and Seider's 

interviews, Corwin noted: 

Clark distinguished between the professional incentives 
—such as the granting arrangements, research institutional 
support and the like permitting researchers to make basic 
research contributions to their discipline at the same 
time as they are focusing on educational institutions and the 
personal values of the researcher, such as the concern for the poor 
quality of many American institutions of primary, secondary and 
higher education. Crane also stressed the more mercenary incentives. 
Her comments, however, suggest that schools of education not 
only fail to control the scientific rewards, but that they are in 
the unfortunate situation of being without control over the kinds 
of rewards which industry has utilized so effectively, (Corwin 
paper, p. 19J 

Implicit in this discussion is the assumption that some researchers 
are motivated to pursue their careers because of intellectual curiosity 
and because of the recognition they gain for their intellectual contributions. 
However, for careers that may not maximize this type of reward, other rewards 
should be available, in order to recruit good people into the field. Among 
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these are facMitatlve arrangements for research, monetary rewards, and 

6 sense of being Influential. Corwin discusses the notion of Influence 

further, In reference to recruiting social scientists Into schools of educs:tlon: 

One of the most important incentives which college? of eduication 
could provide is the opp'ort nity for the >o^^5«' *^-s^ientIst to 
exert an f nf luence on exuii^ ■ For, wh e y7f\^ence presumably 

Is not ^*5t Inst rumenral asrr^^^rr^x of the reward 3^3tem of 
science per se (Stoner, '^^^^i , It does seem to be an Important 
objective of many scient?5itSL impression! sti.:::al ly at least, 
there Is a suspiciously rrigh orrelation betweer. prestige of 
sciemtists and their -rosttt'Qns on influential n-arlonal committees. 

Her . -^in Is advancing an insigh analogy. He has observed pretlglous 

sclent jts on national committees,, ^^pparently, he has ss^ked himself, "how 

do you get scientists to do that typr of thlng?*\ The -znnjecture he offers : 

thst they are willing to forego scientific recognition :f they can feel they 

can have an Impact on policy. But the situation for social scientists 

approaching education is a far cry from what Corwin sees as the natural 

scientist's situation. Ironically, social scientists often find their ideas 

ignored and -their suggestions rebuffed by the very people. In schools of 

education who sought them out. Perhaps social scientists would find colleges 

of education more attractive Jf they were given assurance that they would have 

real authority in such settings. Thus, Corwin is speculating that If social 

scientists felt they had more influence over the conduct of education, they 

might be more willing to work in schools of education. 

On a more general level, Corwin's idea emphasized the view that 

educational research does not have a monolithic reward system, and yet 

the diversity of rewards was not parltcularly apparent in the Planning 

Committee recommendation that attempted to address this problem. This 

limitation inay have affected how the recommendation was received by the AERA 

council. Before turning to that question about rewards that the social 

scientists considered. 
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Fairly early in the Colloquiiur. ^^'^^ii.cf pants raised the question 
of whether the RS can be manipulatesJ ^ ^ prCT^sional assacnatlon In th* 
field. The question of whether the r,.. ^ :£red was first posed by 

BIdwell : 

1 wonder If the problem that ^ «crfront is not one 

of attempting to determine the exrftrc C which either 
through natural evolution of the fwiiK or throuah more 
active Intervention, this rewa-pji ?t-*i^i>tir-e can be aTittered, either 
in Its nature and its location,, t dfr-Wisvelopment orf gatekeepers 
and so on, and of a norma t i vs -S7'£::ann i (ri^ide education which 
will. In fact, provide the indu-X^^-sn -o bring about the kind 
of coherent structure that we s,e^ - .y <j.. :alking about. 
(Bidwell, Colloquium, p. 57.) 

Clearly he has no difficulty accepting tsr ~-zo:r-srce of ttie RS , but Is 
wondering how manlpulable that variable i cquium participants differed 

In their views of how effectively AERA co; ^ ^rrtervene. Storer's view was 
that: 

AERA does not Itself bestow rewards, simply facilitates 
the flow of these rewards from the camnmnity of people that the 
researcher feels Is his audience. (Starsr, Colloquium, page ]kB.) 

He sees AERA's rcle as facilitating rewards, ±73r3ugh such vehicles as 
publications, ratiber than bestowing rewards, mis perception Is quite 
consistent with Storer's knowledge of science, vvrers only siteemed colleagues 
are considered sources of competent response., 

Lin, however, saw the association as ferrEi able to play a somewhat 
more active role In the process: 

I think AERA can help us manipulate the reward structure In 
this sense to bring a new emerging force into the field. I 
think it is very likely that it can be dnne. (Nan Lin, 
Col loquium, page 58. ) 

One means for doing this, In his view. Is b^y starting new, refereed Journals. 

After all of this discussion, the Plann-iing: Committee Report contained 
the following recommendation: 
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RECOMMENDATION 5: The Comimrttee recommends that there 
be established as scgrn as pofssible, a special membership 
category. Fellow of the Aimerlcan Educational Research 
Association. (Report > p. S-) 



Imncedlately following this reconmendation , the report presented some 

of the background to It: 

This recoiroendation emerged out of lengthy discussion 
an4 was formulated with soDme difficulty. Individual 
conimittee members, arter advocating the creation of a 
Fellow category, often turned to a devil's advocate role, 
seeking to find reasons for rejecting the proposal. 
Each return to the negative side of the proposal seemed 
to strengthen It, however, until the conclusion 
to recommend finally was reached. (Report, page 9.) 

After indicating tne careful deliberation that had preceded the recommendation, 

Soodlad (the committee chairman and actual drafter of the report) made a 

parenthetical remark to other committee members and AERA Council members 

receiving the draft copy of the report: 

(Note to Committee members and Association Council: 
succeeding pages present a rationale for the 
Fellows membership category prepared by one member 
of the Committee and subsequently revised by me in the 
light of feedback from some Committee members. 
This statement should not be considered final. Its 
author has not yet approved the present version Hnd 
feedback from the Committee is not yet complete.) 
(Report, page '9.) 

This first paragraph of the rationale describes what two other behavioral 

science associations (psychology and sociology) do in the way of membership 

categories to recognize scholarly excell-ence. The second paragraph Indicated 

how AERA lacks such mi^nibership distinctions. The rationale continues with a 

discussion of the prob^^ems faced by educational research: 

The broad field of educational research lacks a 
coherent sense of col leagueship , widely accepted standards of 
scholarly excellence, and potent incentives for 
- maintaining such standards. In short, the educational research 
community at present does not adequately facilitate the work of 
its members, maintain standards of scholarly performance, or prevent 
the allegiance of educational researchers from being dissipated 
among other, better established disciplines... (Report, page 9.) 
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^ The report views the pres^rr educational researc; anmunitv as diffuse 

and lacking in incentives fen- arariiarly esccellence. Tihe onale -~ .Tcviydes 
witi an argument for how the r&J'^o^is reconmendati^Dn will -^rr: dy the: 
sf tustian; 



First, ir will define the mage zrf the AEHm as an .associa? 
of scnolers and researcher- rsz~^ than of edcicat oraal 
practitioners. This defir lior s important not so inuch tot swr 
'publiic' image, as for the: =harar±er attributed ta AERA 
by researchers in tine sevs-ral disciplines (poiitical 
science, economics, biology, and the Ulce), wino have 
a serious interest in educatiaraal problems. The 
Association will become mcsre attractive to ediucat ronr-1 
.researchers in other fielcB if exemplars of educational 
research ars visible — esaecisllY if the Fellows include 
persons working outside such traditional 'core' areas of 
AERA as educational psychology and measurement. 
Second, Fellow status will s i girif i cantly augment 
and strengthen the system of incentives for work of high 
quality in educational scholarship. Publication by 
educational researchers presently is spread among some 
78 journals. Educational researchers are scattered among 
many disciplines. This disEpers ion iplacaas. severe constraints 

I on quality control and proper evalwationi of research activrty 

Fellow status in AERA sigrsllzes end personalizes the defimitlon 
of good and s igtmlf icant exa^-ationa l research. Elsewhere, tihis 
Report recommenE3 that the associerion enlist as members 
scinolars of diverrse discipf inary background burt interested in 
educational res^rch. If this recommendation is followed, 
it will be essential to provide some generally accepted 
criteria of scholarly excellence and prestige. (Planning 
Report, pp. 9-10.) 

This rationale concludes with the assertion that the Fellows category 
of Tnembership in AERA would enhance the pr-sxige and reputation of the 
Association, so that membership would be -rore rewarding, especially tc researchers 
in the behavioral sciences. 

Going beyond the rationale, in what ways caa« this asrgument ITiustrate 
the penetration of sociological ideas into the decision-makrmc rarocess.T? First, 
this recommendation reveals that the CxBnmittee knows about tt^e concept of the RS. 
Further, their recommendation suggests that they have aCceptsd the importance 
of that concept for recruiting and motivating good researchers. One Colloquium 
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member (Bldwell) indicated in an ntsrvVew that ,he thoagirt 'tie Collcqmiun's 
discussion of t^e RS had a.3n he^nfuJ for some members of Planning Cormltt^. 
rnus, the socia; science y;arspec iwe rr^ have raised cert<^.irr quest ions , or 
considered a particular sr-t of ncsrrr- as relevant and in=s ::ant fo- a 
particular problem. This interrrreta- r.., fs cons istent wit hat another 
Committee member (Schutz) renortsc lioirerview. He sa : the Colloquium 

"may have converged some of (our) -^. -tg. It's a questico- of finding 
a framework for salient iss..9S. . .^s a lot of time." io the sociologists 

may Kavs presenter a conceptual fr^m^^apK with which to cor^Bider a particular 
phenomenon. Third, this rscoeimencsctLon .:assumes that ft£RA r-nfTuence 
the operation of the RS wltfi posit, ve cz::Tsecuences . Thus, i t would appear 
that the policy-makers accepted ths assart ions of Garvey, Neison, Lin and 
other social scientists at the Col Icquium- trhat AERA could positively influence 
the RS. 

Assuming that so-ial scienristo orovide a conceptus-l framework, 
stressed the iniportance of that --rsnewon*;, anc provided a brEsIs for believing 
in the efficacy of interventlor. - thera any swidence to suggest that 
sociology was utilized In the e^isrmi nation of -he fnrrr intervention 
should take? An organization influence tiss opera-: r,~ of the researrh 
system through indirect ani d r rscr rassans . Thus,, as SKarssr noted, an 
association can f acl 1 itats tne • =rxui:af ion of recogmtiojr and rewards among 
its members indirectly th-ads-n tra cswwinlcatrlans Tneci-anisr- it provides. 
Awarding prize or honors is a mjr^^^ ar-sct way of msTrou lat.ion rewards. 
Clearly the Planning Ccmmlttee's P'-Uiaws reccBnmencsri^on is a rather general 
instance of the latter. 

Within the formal RS.'hrow diEi: AERA decide on the particular means 

embodied In this recommendation? Thespeclfic proposal niade was the 

brainchild of two Planning Committee members. Bldwell reported in an interview 

that "McLean end I drearBed it ur. over ^linner (one night s'^ter a Planning 
O or; 
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Committee meeticag)." Hi dwell is inimself a sociologis altncugb not 
specifically a soclolcc ist of science. %o here is a case ot a sociologist 
serv^Ing om the Planning Committee and nial<l?ig policy recommsrcdatiions . 
We might conclude from this that his sociological sensitiv y interests 
influenced both the general and the specific content of tha recaantnendat Ion. 

One imp^jrtacTt aspect of the reward system dtscussac b^: d^e Col Tcajqufuam 
does not appear in this recommendat?ton. Specifically^ che^re (5 mo mention of 
the Giossifaility of di\^erse rewards zhaz would in some i^.gy reeled the varieiry 
of jsals pursued by AESA members. 1h\s omission may explain m part why 
one R J aiming Commi tt^e: member reportsn That the Fellows re uuE i uita ndat ion 
was rnc Idea that was '^st reluctarrtly acccipted by the Planr vng Committ:eeJ' 
(Mcljssan Interview.) I t wasn* t just the Planning Committree rnat was reluirtant 
about the Fellows proposal . The executive officer of AcRA escribed It -as one 
of ttie ^'stickiest wickets*' in the whole report. He ^id thatr (Counci 1 might 
want;to refer the Idea to a committee. One member of the CcvjT.cil said, ''We 
discussed the Fell-ows in the June Coui^ri ■ (rfj^cing). . sz\]] feel the same 
way. 1 want to know the Committee's 'at4onele," Thii s*i.a?e mejmber felt 
that the Fellows recommendations aimec A£RA's priorit' f^- compllietely at scholars. 
Another Council meniber suggested that tnie Counc?* nigr*, wa^rr: tro vrast a much 
broaaler reaction from the whole AERA irsimfaisrrmiip cct ths 'desa of' Fellows. ASso, 
he re'*r they needed more informatior^ atmuit the c vTrts .o^ suxh a plan. (He 
seemea to mean both financial and organfrratiional costs.) He felt that the 
implications of such a suggestion needed to be probed. The Council was 
cleariy not prepared to take action on this recommendation at the December 
1969 n:jeeting. They felt they should w^it tir see what the By-Laws 
Committee recommended about membership., before they decided or this reccmmiendation. 
This reaction on the part of AERA's IjouTTr:,n may reflect the~T^iluTe of the 
Planning Committee to recognize the :Sixi:stence of other cons trtuents In AERA 
^*^;sldes scholars, and hence, to provtde some ciiJ vers ity in the rewards that 
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were offered. 

the fact that the AERA Council did not endorse the Fellows prapossl 
mfght be explained by one of two different '^theories of organ? zatlonal 
comfUct," First, what might be termed the ''fsulty communications theorv 
of conf I let./' would argue that If Council members were f^iflar with tte- 
cojicept of ffeward system, 'were corrvr.nced of its importance and believed AERA 
could successfully intervene In the proposed way, then they would have 
accepted the proposal. On the other hand^ the "opposiTig aterests"' thecr\' 
would maintain that even complete knowledge of the reseamrh system would rmt 
persuade reluctant Council members to accept the Fel lc»w^ pr-oposal , becaiase 
they, as "educational developers" had interests basicaMy different from tine 
Interests of scholars which would be served by the prcraj^a; . 
B, The Communication System 

AERA's interest in the communication system (CS) rested upojii the 
assumption that the CS facll Itated the functioning of the Ti^flwer::? sysnsrj, 
influenced the quality of research and thus perhaps ind,irfiE::;r^Iv Imcre^ed rm^ 
political influence of AERA (See Figure A). Ir; colloaulum ai iscass icns , tme 
concept of the CS was a very general one, encomoassinc at: ^i;~t two -^jcr- 
aspects, namely, internal coirwunicatlon and e^ctsrnal commum* Tsstion. :3y 
Internal communication was meant problems within the field -of educational 
research such as the organization, composition, and , knowledge transmiss I-on 
functions of the annual meeting, e.g.^. how much chance H rrrere to wetet 
colleagues interested in similar problems, or how manr- :3ais3p?s whc 
hear a paper knew In advance that the author was worktrng :on "that isiroblsmf 
A 1 scr ccons I de red to be problems of internal commun i cat icon were pubiKIcstran 
patterms of educational researchers, and the subs tatice and standards .of 
Journals in the field, especially those published by /5ERA. Problems cof 
external communication included relations with the behavioral sciences, 

especially how AERA could get more behavioral scIentM"^ as memfaer- 
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^ through appealing publication outlets. A prime problem of external communication 
was the question of influencing general research policies of funding agents. 
As noted In Chapter 1, this last concern was a major factor in stimulating 
Dershlmer to call the Colloquium. It is noteworthy that what was originally 
a central concern became less important in the Colloquium discussions, 
perhaps because there were no data commissioned on the subject. Thus, we may 
surmise that when a '^client*' fails zo commission research on a subject, that 
topic may get buried beneath available data on another subject. 

The Internal communications structure was the single most discussed 
problem In the papers, the Colloquium and the Planning Report. Two cormlssloned 
papers were devoted very specirically to the topic (Garvey"s and Paisley's) 
and other papers noted Che importances of communications for the functioning 
of the reward system and for entiantjng research quality. In the Colloquium 
alone^ internal communications receilved at least 25 Independent mentions. 
Discussions of Internal commmni cation centered primarily upon (l) the 
AERA Annual Meeting and (2) AERA publications. 

K The Annual MeetUng 

Both Paisley and Garvey felt that the AERA annual meeting was not as 
effective as it might be In facilitating communication among members: "In 
comparison with the potential impact of a scientific meeting on its field, 
we are really limping along on one out of eight poss'ible cylinders." (Paisley, 
Colloquium, page 158.) Paisley's view^of the inefficiency of the AERA annual 
meeting Is based on his general^ impressions of the association In combination 
with the concept of 'Mnvisible colleges" which he brought from the work of 
Derek Price (1963) and Diana Crane (I96 , 1972), 

Garvey's feeling that the AERA annual meeting could be Improved 
arose from his empirical study of the I969 AERA meeting, which he compared 
with data he had on eight other professional associations. Garvey, Nelson 
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and Lin found, for example, that only ten percent of people attending a paper 

presentation at AERA were acquainted with any of the author's previous work 

and only 20 percent had any previous knowledge of the content of presentations 

(for example, 12 percent had read the abstract of a paper before attending 

the presentation, Garvey, Nelson, Lin paper, p, 17). On these measures, 

educational research was lower than any of the other fields studied (Garvey, 

Colloquium, p. 188). From this Garvey concludes: 'There is something lacking 

in the whole network, prior to the meeting," (Garvey, Colloquium, p. 188.) 

From their perspectives. Paisley and Garvey make several specific 

recommendations about how AERA could improve its annual meeting. Paisley 

thinks that the ''invisible colleges" could be utilized to create a much 

more dynamic annual meeting: 

The irony is that the invisible college is a great untapped resource. 
The best people in the field are sitting on data developments, ideas 
and enthusiasms that they chiefly disseminate among themselves; 
. whereas, at the annual meeting where so much of the society's image 
is perpetuated year after year, the sessions are given over to the 
least interesting and least competent material. (Paisley, Colloquium, 
p. 159). 

What seems to me a logical extension of the best pattern of Invisible 
college interchange is an annual meet jng Q rgppi ^ed around -invisible 
qq^ l^fle«? as a fair organized around special buildings. Various 
associations have chosen to scrap divisional structures in favor of 
^special interest groups,' which is the name invisible colleges 
sometimes give themselves when they come out Into the open. These 
associations have, in some cases, taken the additional step of allocating 
convention time to the SIG's just as APA and AERA now allocate time 
to divisions. (Paisley paper, p. 26.) 

Instead of that kind of marketplace of ideas, I think the 
professional meeting might be more nearly a tutorial session, a 
five-day tutorial session instead of a one-day presentation in which 
the invisible colleges say their piece for the year. 

Thus, by organizing annual meetings around the interests of invisible colleges. 

Paisley thinks that the best data developments and ideas would be presented ■ 

to the meeting attenders in general, rather than Just to other members of 

a particular invisible college. He goes on to cite as evidence for this 

argument the interest in APA symposia: 
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^ Consider. .the relative popularity of an APA sympos Jum wh fch b&s been 

mounted by really first-rate people in the field, versus a typical 
APA session, and a typical APA session is a session that has imposed 
a fairly high level of screening on the papers that it accepts, but 
even within that narrowing of difference, the symposia are. ...of so 
much more value, because they do represent platforms for invisible 
coUeges. 

Paisley notes that tendencies In AERA lend themselves to further movement in 
the direction he proposes. 

The emergence of special interest groups In AERA seems to be 
a natural opportunity to transform the convention from a laissez faire 
marketplace of ideas to a set of exposure experiences that is programned 
to achieve a certain goal for educational research, even If you have 
to feel that you are being somewhat manipulative as you are doing It. 
(Paisley, Colloquium, p. l60.) 

Paisley's recommendations are based on the assumption that "invisible 
colleges" actually exist in educational research. Further, he believes 
that deliberate efforts should be made to design the annual meeting to conform 
to the structure of "invisible colleges." 

Garvey's recommendations, on the other hand, are based on his 

empirical data, are much smaller in scope and are relatively Independent of the 

structure of the annual meeting. For example, 

one of the first things I would do is publish abstracts, prior 

to the meeting. (Garvey, Colloquium, p. I87J 

He thinks that publishing abstracts prior to the meeting would provide the 

chance for more people to become familiar with the content of the papers 

before attending the meeting. This is an example of a recommendation 

coming from a social scientist's very concrete empirical finding. It is 

designed to rectify a deficiency in communication behavior that he observed. 

These examples show that social scientists made recommendations 

to policy makers either based on the conceptual framework they 

brought to the problem or by drawing on their own empirical study of the 

problem. 
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While the social scientists addressed themselves quite directly 

and specifically to the problem of improving the annual meeting, the Planning 

Committee did not respond as directly or specifically. They recoimended : 

That the Annual Meeting increasingly be directed to advancing the 
field of educational research through the presentation of exemplar 
reports as (SIC) truly significant research underway, critical 
analysis of research developments in the various sub-fields, 
symposia on frontier developments, and cross-discipline progress 
reports on efforts designed to advance koowledge about critical 
social -educational problems. (Planning Report, p. 21.) 

It Is hard to see how this recommendation differs from what everyone hoped 
the annual meeting was doing anyway. In other words, it Is more an 
expression of vague sentiment than a call for any changes in structure or 
practice 

The Planning Report contains only one recommendation that can be 
seen as suggesting a change in AERA procedure: 

The Committee urges continued analysis of all meetings, research 
of the kind recently instituted. (Pjanning Report, p. 22.) 

By this they meant empirical studies like those of Garvey,- Nelson and Lin 

which described the actual knowledge and behavior of attenders and paper 

givers at AERA meeti ngs . This recommendation suggests that they felt 

Garvey's data had value, even though it is hard to see a direct effect from 

Garvey'S data with respect to the annual meeting. Several Planning Committee 

members (Bidwell, Gage) felt that this recommendation was a direct result 

of Garvey's paper and the Colloquium, although one member felt that AERA 

was committed to analyzing the meetings before the Col loqu ium occurred . We 

can only speculate about how they thought it resulted from the Colloquium. 

One possibility is that because Garvey's paper (as noted In Figure 2) 

was the only one with substantial original empirical data in it, it stood out 

from the others and made AERA planners feel they had new information about AERA. 
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( Besides contrasting with the more theoretical papers, Garvey's paper 
reported what may have been quite surprising findings. For example, the 
degree to which AERA members, compared to members of other professional 
associations, were not aware of work of interest to them being done by other 
researchers may have dramatized AERA's communications problems for planners 
and, thereby, convinced them that they should not be so unaware of what 
was happening in their own association. 

It may have been this view that underlay BidwelTs comment that he 
felt more data were needed before decisions could be made about the frequency 
and structure of annual meetings (interview, 2/70). He did not say what 
kind of data would be useful. It may also be the case that AERA planners who 
are themselves empirical researchers find a certain comfort and Joy In data. 
They may feel that data has intrinsic value even if this value Is not always 
reflected In policy recommendat Ions . 
2. Publications 

While the Planning Report contained few specific recommendations 
about the annual meeting, that was not the case with respect to AERA 
publications. At the time of the Colloquium, AERA had three publications: 
The American Educational Research Journal (AERJ), a selective quarterly journal 
publishing fairly lengthy original research articles on education; the 
quarterly Review of Educational Research (RER) whi ch' publ Ished review articles 
on common topics; and the Educational Researcher (ER) a bi-monthly newsletter 
of the Association. All AERA members receive all three publications, and 
non-members can subscribe to the journals. 

The Colloquium discussion about AERA journals focused around three 
problems Included In Figure k. First, it addressed the problem of facilitating 
communication among educational researchers. Second, the Colloquium 
considered the question of how AERA could use its journals to be more 
inclusive of the educational research community (part of the problem of defining 
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the nature of the educational research community), and discussion centered 

on how AERA could use its publications to relate better to a larger "audience" 

(related to the problem of AERA's political influence). 

One way to facilitate communication is to help researchers keep up 
with the literature. As one^AERA member noted, "it has been recoimended that 
we expand AERJ markedly, so we don't have to scan 18 journals as we now do." 

(Krathwohl, Colloquium, p. 177.) 

Colloquium participants were quite concerned with how the AERA 

publications would help keep researchers abreast of current work, and they 

made a number of specific suggestions addressing that problem. For example, 

What would happen if you took the journal as it is, and then 
just added in a page c i t i ng , . . th i ngs that have appeared elsewhere 
recently? Which would then make you at least the bibliographical source, 
and might draw more people to you, to AERJ. That would be an interim 
step. (Storer, Colloquium, p. I78.) 

Garvey also had two specific suggestions. 

I would like to see the journals publish manuscripts received (that 

is, titles) authors and addresses, in order to get back farther. 
There is a long period of ]k months, as I mentioned in. the article, 
in which nothing really happens here, and that is really a very 
dead spot in this particular system. (Garvey, Colloquium, p. I90.) 

This suggestion is designed to expedite the time between completion of an 

article and Its utilization. This recommendation was based on his knowledge 

that researchers working In an area write to authors of completed manuscripts. 

Here, again, he is using empirical data (having measgred the time lag between 

various steps in research and publication) he collected to formulate a 

suggestion. 

Simi larly he notes : 

A large portion — and I think it is 60 percent of the authors 
of articles have already started new work derived from the work 
that is in the process of being published, and that has reached 
the report state before his article Is published. It seems to 
me that something could be done here, simply maybe a footnote, 
saying the author has currently about finished his piece of 
research derived from this, in which he is manipulating variable 
X and measurinq variabtfe y just ehouqh to tie this in, rather thon 
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wait another 18 months. (Garvey, Colloquium, p. 191.) 
Again, his knowledge that authors of published articles have often finished 
a report on a subsequent piece of research led him to recommend a practice 
that would reduce the time lag in disseminating knowledge about that work. 

- Both the problem of keeping up with relevant literature and the 
time lag between completed and published research were addressed by the 
Planning Committee^s recommendation that the Divisions of the Association be 
encouraged to experiment with quick, informal means of serving members such 
as distributing prepubl ication copies of articles, reprints of tables. of 
contents from relevant Journals, and checklists of research currently underway. 
(Planning Report, p. k.) However, the Report does not spell out specific 
mechanisms for dealing with the problem. 

The idea of facilitating the exchange of information was refined by 

Gage (a Planning Committee member). He felt AERA should do more to 

stimulate a cr I t leal review of relevant literature in different problem areas: 

AERA sorrily needs a Journal that will carry volunteered papers 
reviewing, criticizing educational research, much more similar to 
the Psychological Bui let in than anything we have now, or anything 
that would be, could be done by the Review or, say, even an 
annual review of educational research, where the reviews and criticisms 
are commissioned on a cyclical basis. 

The volunteered criticism of a field of research which some man 
produces, because he can't keep himself from producing It, he Is 
so Interested In it, and so expert on the subject, that kind of 
thing we don't have any medium for now, arfd I think we certainly 
ought to think about it. (Gage, Colloquium, p. 176.) 

Gage stresses the need for a critical review of the accumulated research 

on a particular problem. As envisioned by Gage, this Journal* would contain 

critical analyses of both the methodology and substance of educational 

research, like the comparable Journal in psychology. (Gage Interview.) 

This Idea appears in the Planning Repoft in the following form: 

RECOMMENDATION 3-3: That the Review of Educational Research be 
converted to the Psychological Bulletin type of review. ,.. (PlannI ng 
Keport , p. h) . • 
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Here is almost verbatim acceptance of an idea that appeared In the 
Colloquium. It is important to note that this idea did not spring full 
blown from the head of Jove, however, since Gage indicated in an interview 
that the Idea did not originate at the Colloquium, but was an Idea he had 
held for some time. Gage's role in advancing that idea was recalled by at 
least one other Planning Committee member. Recalling the Planning deliberations, 
McLean said that Committee members were trying .to make educational research 
a more self-policing profession, with critical reviews. He said they 
discussed a Psychological Bulletin type of publication and that Gage was an 
advocate for that. (Interview with McLean.) 

What the history of this idea suggests is that sociological theory 
or data may serve to reinforce and strengthen a policy-maker's .conviction 
that his idea is important and should be pursued. In this case". Colloquium 
may have served to make others more receptive to Gage's ideas, since the 
ideas were congruent with those presented by the social scientists. 

In general terms, several Planning Committee members Indicated 
that they thought that the publications recommendations were the clearest 
example of the influence of the Colloquium on the Planning Committee (e.g., 
McLean Interview). 

In addition, to facilitating communication among researchers, AERA 
was concerned with how It might use its journals to' make AERA more 
Inclusive of the educational research community. To attract scholars from 
the behavioral sciences, the Planning Report recommends changing the AERJ , 
the journal publishing original research reports: 

At present the AERA does not provide a publications program, either in 
image or reality, of the kind required by the broader community 
of scholars In education the Association should attract. During 
recent years, there has been a serious effort to broaden the coverage 
of the AERJ . ^ But this journal still leans heavily toward educational 
psychology, in fact, and even more in image. 
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The Committee proposes that more effort be expended toward making 
the AERJ a journal for the broader universe of educational research. 
This might be done, for example, by devoting each issue to a 
different discipline, cluster of disciplines, or sample of problems 
and methods. We must recognize, however, that the AERJ Is 
approaching or has attained maximum size for the journal format and 
that there is now both a formidable backlog of articles and an 
even more formidable rejection rate. These Indices point 
to the need for creating ultimately — and ultimately already 
may be here a journal designed at the outset to embrace 
the field of educational research as defined in this report 
(Planning Report, p. 5.) 

While the Committee recommended changing the focus of AERA's major 
Journal so as to be more inclusive of behavioral scientists, there was 
another problem of inclusiveness faced by the association that could only 
be identified, without a solution being offered. That was the problem of 
including younger researchers in the internal communication systems of 
the association (publications and annual meetings). The Planning Report 
states: 

The Committee identified a growing need for vastly Improved Informal 
communication within the Association among scholars pursuing comparable 
or parallel areas of interest. Some of this nowgoes on among small 
clusters of persons who have initiated agreements to exchange 
progress reports. But more needs to be done by the units (Interest 
groups and divisions) of the Association, especially for those 
younger researchers who find it difficult to create or gain entry to 
clusters in which communication occurs. The Association Council 
should encourage the divisions to assume responsibility for assessing 
the need for scholarly communication... (p. 5). 

This statement is particularly important in light of the relative 
youth of the AERA membership. As noted in Chapter 1 more than two thirds 
of AERA members in 1970 had received their highest degree in the prior 
decade. Hence, the problems of facilitating communication and being inclusive 
of more members of the educational research community is especially 
relevant for younger researchers. 

The foregoing discussion has been concerned with communication 
either within AERA or at least within the educational research community. 
The Colloquium and the Planning Committee, however, were also concerned 
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^ the clear Implication that this might enhance public and Congressional 
support for educational research. 

Only one statement In either the papers or the Colloquium refers to * 
how AERA might use its publications to increase its influence on research 
policy. That was a statement Orlans made in an i nterv iew wi th Corwin. Orlans 
said: 

I'd like to see more profess ional group.s like AERA in other areas of 
activity like medical research. You have a very fragmented kind 
of information. You get snips of news of a National Science 
Foundation policy in Physics Today or in Chemical and Engineering 
News^. Most of the social science professions have gone to a special 
publication, such as the American Psycho 1 09 is t . the American 
Sociologist and P.S. . but those really deal with professional 
matters.. .It doesn't add up to a continuing examination of major 
government programs and significant changes let alone informing 
people about them in time so that they can express their views before 
a change in research policy occurs, i think AERA has been 
In a natural position to do that, and I'd only like to see more 
efforts of this kind in the soc ial sci ences . It would be both to 
k the benefit of the social scien-ce prof ess ions , and, of course, 

to the government. It keeps those ^government people on their toes. 
(Orlans, quoted in Corwin paper:, pu. 21.) 

As articulated by Orlans to Corwin, AERA cziuld play a focal role in 
disseminating and critically examining new professional developments. In 
this way, people might begin to look to AERA for news and commentary. If 
It became an arbiter it might exert more influence on professional matters 
that Impinged upon its members. 

In regard to communicating with a larger audience, the Planning 
Committee recommendations went far beyond anything suggested in the papers 
or at the Colloquium. This is quite different from the problem of Internal 
communication where paper and Colloquium ideas are both more numerous and 
more specific than Committee recommendations. With respect to external 
communication, the Committee recommended that: ^ 
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the Educational Researcher be converted into Educational Science 
(tentative title) a journal fashioned after Science devoted to 'an 
outward look' from the perspective of advances in educational science, 
to communication across segments of the educational community 1 and 
to Associational business, news, and special reports. (Report, pp. 2-3.) 
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After presenting this recommendation, the Report described In detail the 

Committee's rationale: 

We have in mind a publication that would speak to and for the 
broad educational research community we are seeking to pull 
within the orbit of the AERA and that would report research 
developments to both educational practitioners and 
Interested laymen (members of Congress, School boards, foundations, 
etc.). Such a publication would seek to describe the nature of the 
educational research community and Its work, speak for research- 
based educational policies, provide a quality conscience for the 
educational enterprise, monitor the field through effective criticism, 
reduce the time lag In regard to scholarly review of highly visible 
educational projects, and assist in establishing some coherency 
with respect to the .advancement of educational science. These i 
purposes would be achieved through the publication of general 
articles defining and assessing ongoing research, summarizing 
findings and implications, and pinpointing areas of research 
neglect; through news and comment perta'iT)ing to the research community; 
through editorial comment on the state cf tte'ii field. Brvef 
research reports such ss th^se contained innme back pag^ of Science 
might serve to attracr contrri but ions from otssr discipl ines engaged 
in educational researcm. . . « (Planning Reporr:, p. k.) 

This very ambitious re^mmendatlon proposes crrastically changing 
the AERA's short (five to eightrziage) newsletter fnto a, Science type publication 
that would "provide a quality conscience," "reduce the time lag" and 
advance educational science. It would report research developments to both 
educational practitioners and interested laymen. Clearly the objective of 
this recommendation is to increase the influence and prestige of AERA and 
educational research generally. 

The Committee "discussed at length the problem of interpreting 
educational research and its importance to several audiences, but was unable 
to produce firm recommendations beyond those set fort^ above." (Planning 
Report, p. 5.) They did express a belief, however, 

that some of the suggestions emerging from Committee discourse 
have merit. One is that the Publications Committee convene 
a meeting of persons who have written about education for 
public consumption (e.g., Paul Woodring, Frank Jenni ngs , and 
Fred Hechlnger) to discuss ways of developing writer interpreters of 
educatjonal science. Another is that the AERA persuade a highly 
visible educational researcher (who is able to write for the lay 
public) to write a syndicated column on the field. Still another 
is that the executive office establish the kind of communications 
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wfth the press,, that would lead to the reporting of educat ional research 
I In popular media. Some efforts along this line already have been made 

sufficient to reveal that the popularization of what educational 
research contributes and what educational researchers do wi 1 1 not 
be easy. Nonetheless, the . Conrvn? ttee regards the interpretive function 
to be of critical importance for the AERA to assume. (Planning 
Report, pp. 5-6.) 

Thus, the AERA Planning Committee thought that thefr communication 
efforts should be concerned with wide external communications, as well as 
with improving internal communications. 
C. Qual i ty Control 

As irrdicated in Figure d, many of the Col loquiumrparticipants 
perceived at east an implicit relationship between the -xirmunlcation 
system (CS) , reward system (RS) anc the qua 1 i ty of educational research. 
Some of these linkages have already- been considered in tfe previous two sections. 
Here we will focus specifically on the concept of quality. 

The papers solicited for the Colloquium discussed several aspects 
of the problem, namely; (a) the importance of improving educational research, 
(b) how the quality control system works in other scientific fields, and (c) how 
educational research might be improved. At the Colloquium, participants 
considered many specific ideas about how quality could be enhanced. 

The importance of improving educational research was highlighted by 
Corwln, who reported in his paper that 

the underlying importance of fostering high quality research 
was designated by Zuckerman as the chief problem facing 
educational research. (Corwin paper, p. 10, reporting on his 
interview with Zuckerman.) 

The agreement of many Colloquium participants with the importance of quality 

is apparent in the considerable time that was spent discussing how research 

could be improved. Some participants seemed to see the concern with quality 

as being of intrinsic worth. Others seemed to view quality as both Intrinsically 

Important and as instrumental ly necessary, so as to enhance and legitimize 

the political Influence of AERA and educational research generally. 
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While several papers stressed the importance of quality for a scienfffic 
fle^ld, only one paper mentioned a specific way that research might be 
improved. From his own thinking and from an Interview wi th Cole, Corwin 
raises the question of quality control: 

What seems to have been a boon to educational research — the rapid 
expansion of research funds following in the wal<e of the I965 ESE 
Act — may have been a disservice. Speal<ing to the problem of 
how to get better educational research, Cole suggests that funding 
agencies supporting research on education should cut baci< their 
budgets rather than give grants to people who don't present adequate 
credentials or adequate proposals. (Corwin paper, p. 1^.) 

This funding-reduction approach to Improving quality was not picl<ed 
up by the Planning Committee. Rather, Colloquium-participants discussed two principal 
means of quality control: starting new journals and raising Journal standards. 
In the previous section, we noted Gage's interest in starting a Journal of 
critical reviews so we will not consider that means further here. 

With regard to raising Journal standards, Storer said. 

If you can't beat them (other disciplines with more prestige). 
Join them. The only way to solve this is to imjirove the toughness 
of editorial standards for Journals in your own field. And this 
is a long, slow process, and a lot of heads get crocked along 
the way, but it is the only mi in the long run to make it as 
rewarding in, say, the one cited by you. (Storer, Colloquium, p. 133.) 

Here he is implying that if editorial standards are raised, the prestige of 
the affected Journal will be enhanced, which will increase the desire of 
individuals to publish in that Journal and reap the rewards of doing so. Thus, 
Storer is suggesting the interrelation of the reward and communications systems, and 
their implications for quality. 

There is an enormous shift in many fields of science toward policy 
research and away from conceptual research, and the temper 
of the country is requiring it right now. I f we are not tough- 
minded with ourselves as we turn out policy research products, we 
painfully learn that other people will be, and that the methodology 
that was adequate for conceptual research is not 
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) adequate for policy research. (Paisley, Colloquium, p. I6l J 

He thinks standards need to be raised because educational research wiFil 1 

increasingly be Judged for. its utility for policy-making and those standards 

may be more severe than the ones for academic research, though he doesn't 

indicate the sense in which standards may be more rigorous in policy research. 

Like Gage, Paisley feels that the best way to raise standards may 

be by starting a new journal: 

I think AERA should be cognizant of the concept of 

a best match between an objective, such as perhaps 

raising the standards of methodological practice 

in educational research, and a function to meet that 

objective such as a new AERA journal that might be called "Review 

of Educational Methodology/' (Pa i s ley , Col loqu i um, p. 155.) 

Thus, he feels that the way to stress new goals is through new means. Since 

a central purpose of the Planning Report was to stimulate the "quality of 

productivity of the educational research community" (Report, 1), 

it Is impossible to single out one Or two recommendations that were soilely 

addressed to the problem of raising quality. Rather, many cf the communiicat i(ons 

and reward system proposals already discussed were probably -made 

because they were expected to enhance the quality of educational research:. 

Therefore, it is important to analyze how all three . (rewards , communications, 

and quality) were implicitly seen as being related to a fourth major 

problem facing AERA: how the association could increase its political 

influence.. 

D. Political Influence of AERA 

As noted at the outset, AERA's lack of influence on the agencies 
funding educational research was one of the reasons for calling the Colloquium. 
The AERA Executive Director felt that unlike associations In other areas (e.g.,' 
science, medicine, agriculture), AERA had virtually no impact on federal 
educational research policy. 
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fn his paper, Hagstrom remarked on three features of the relationship 
between scientific societies and government agencies which distinguish the 
natural sciences from education. First he noted the-development of advisory 
panels as a mechanism for funding research: ' 

In most of the basic sciences university scientists Influence 
decision about the funding of research at many levels of govern- 
ment and the foundations. The invention of advisory panel s and 
the project system in the United States following ]3kO seems to 
have been very successful; the government has been able to support 
research without taking away the freedom of scientists or scientific 
organizations, and it seems as if decisions at lower levels usually 
allocate research funds efficiently. (Hagstrom, paper, p. 11.) 

While at the time of this writing these panels are under fire from the 

Nixon administration, Hags trom wrote in I968 nothing how such panels served to 

preserve the freedom of scientists. For those concerned with the Influence 

of scientific societies on research funding, Hagstrom observed: 

Ordinarily the sci:entific society plavs little formal role In making 

decisions or selecting the personnel for advisory panels, but 

Informal ly the society can provide a locus for discussions about 

the right men to be selected for advisory panels. (Hagstrom. paper, p. 31.) 

Thus, Hagstrom feels that while a society cannot select the panel members, It 

can play an informal role in advancing research needs or possible panel 

members. Nevertheless, with regard to educational research, Hagstrom is 

generally pessimistic about the Influence of societies: 

In the area of educational research scientific societies seem 
to have had much less influence on governmental and foundation 
policies than in the established sciences or medicine. This 
may be due partly to the rather recent growth of government 
efforts in educational research. It is also possible that this 
lack of influence stems from a lack of legitimacy of 
education researchers in the eyes of the relevant publics ~ 
the academic disciplines and the intellectual community more 
generally — and from the great power of educational administrators 
at local and state levels. (Hagstrom paper, p. 11.) 

In this instance Hagstrom, himself a sociologist. Is adding his 

reflections to the client's perceptions of the problem. It Is not clear 

how his statements could be used as anything but a general context for policy 

del Iberatlons. 
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Like Hagstrom, Corwin also compares educational research with the 

physical sciences. Commenting on his i nterview wi th Zuckerman, Corwin notes: 

In; the physical sciences, the agencies distributing research 
funds frequently have been headed and staffed by leading 
scientists. Commenting on this fact, Zuckerman speculated (that) 
the fact that a first class physical chemist heads the 
Atomic Energy Commission perhaps prevents split from 
developing between bureaucrats and professionals. She noted 
that it is a common . pract i ce to appoint professionals on a 
temporary basis to such agencies. (Corwin paper, p. 38.) 

Zuckerman suggests that a split between agency personnel arid scientists 

Is unlikely in physics because agency heads are often leading scientists. 

Corwin offers two speculations about why this may be the case: 

However, th3 route by which physical scientists have come into 

these positions of influence within the operating agencies is 

less obvious. Many factors appear to be Involved, For one 

thing, physical scientists are less reluctant than social scientists 

to accept employment outside the academy (which may reflect 

greater security provided by more mature disciplines); 

in many of the newer agencies they were in on the ground 

floor when the agency developed (which Is not the case for an old 

line agency like the Office of Education). (Corwin paper, 

p. 38.) 

Corwin's suggestion that physical scientists are less hesitant than social 

scientists to work outside of universities would be an interesting question 

to explore empirically. His other explanation, that physical scientists 

are more likely than social scientists to have been in on the ground floor, 

warrants examination in light of the recently developed NIE. 

Final ly> as a major reason why education has had less influence 

than the physical sciences on research policy, Corwin reports Cole's observation 

few laymen would try to tell physicists what to do whereas 
many people in education without research backgrounds feel 
that they're social scientists. (Corwin paper, p. 39.) 

Implicit in this observation Is the question of whether the authority of 

educational researchers is accepted as legitimate. Sociologists have 

observed and analyzed a number of conditions that are related to whether or 
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^ not a given authority is accepted as legitimate, but none of that background 
was presented or discussed for policy makers. In this example I think that 
sociological insights are presented fn a form that might be considered 
CryptfC for @ non-sociologist. By this I mean that the matrix of meaning in 
which these Ideas are embedded in the heads of sociologists may not exist 
in the heads of policy makers. Thus, these cases may be prime illustrations 
of the "distance" between sociologists and poli^cy makers. It would be 
interesting to examine whether in instances of extensive utilization, the 
"distance" was narrowed in part by explicating more specifically the matrix 
of the sociologist's ideas and thus by imparting more of that conceptual or 
empirical matrix to the policy maker. . 

« Corwin then made several specific Tecommendat ions in his paper: 

Political activity might take two distinct directions. First, 
the development of greater coherence and unity within a field 
^ requires that people In the field develop some influence over 

Its sources of support. The field might be example establish 
policy committees to make recommendations to government funding 
agencies and look Into ways of encouraging social scientists to 
exercise more influence in research policy matters. In com- 
parison with some other fields, social scientists have not as yet 
found representation in government staff positions and key committees 
to an extent to sufficiently exercieJe significant influence. 
(Corwtn paper, p. 52.) 

Here he suggests that AERA establish conmittees to take policy positions on 
research funding. This proposal breaks with AERA's past history of uninvolvement 
Corwin goes on to recommend that: 

some efforts might be directed to influencing legislation itself. 

in particular, there is need for separate legislation for the 

support of basic and applied research, as opposed to development 

and service. The Congress and the public generally hold different 

expectations for each type of activity and the people 

responsible for each type of work will be held accountable in different 

ways. (Corwin paper, p. 52.) 

By suggesting separate legislation to support basic research, Corwin Is 

reflecting the concern of discipline researchers that they not be Judged 

only by practical considerations. Nevertheless, both of Corwin's conments 
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^ imply that AERA's influence was low. 

Despite agreement among two paper writers and the AERA Executive 

Officer that AERA's influence on federal research policy was minimal 

(and by implication that this was an important problem), however, the 

Colloquium devoted very little discussion to the issue. There was one 

conversation on che subject between Storer and Henna. (an AERA staff member): 

HANNA: You pointed out medical research ... and agriculture* 

research. I assume that they are both more mature fields 
than education. 

STORER: That is true. 

HANNA: Did they cross this bridge (of encouraging both basic 

research and practitioners) and how did they solve the 
• problem? 

STORER: Mostly with massive support for all sorts of 

activities from outside. The Governemnt thought for the 
last hundred years that agricultural research was 
iimportant, and for 20 years that medical research 
was" also. . . 

HANNA: But they don't presumably feel that educational research 
is that important. 

STORER: I think they are coming to it. The problem is now to 

get them to put their money into communication mechanisms 

like journals and review panels, and so on, rather 

than simply research funding. I don't know hw 

money is allocated, and how it is spread between 

the two different functions. (Colloquium, pp. 126-127.) 

Tv/o issues underlie this exchange. First, there is the question of 

how and why education is different from medicine an^ agriculture. It could 

be that the differences implied by Storer and Hanna are the result of 

varying degrees to which the various roles of researcher, developer, disseminator 

and practftioner are institutionalized in the different field. Another 

explanation for the different relationships between education, agriculture, 

medicine and federal agencies might stem from the importance each of those 

fields has for the economic and stratification systems of society. Since 
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^ the educational system as It presently operates corresponds relatively well 
to the economic and stratification systems, educational research may well 
have a lower priority in the federal budget than medical or agricultural 
research. 

The second issue raised by Storer and Hannahs exchange is the question 
of the difference between support for research itself and support for 
mechanisms that promote good research. Implicit in Storer's statement is 
the assumption that journals and review panels are important for enhancing 
the quality of research. 

It is interesting to note that Storer and Hanna were discussing 
general policy stances federal agencies might take, without making any 
direct reference to how AERA might influence that policy. 

The most direct reference in the Colloquium to the problem of 
I Increasing AERA's political influence was Goodlad's (Planning Committee 
Chairman) reminder of the prer^^ding Planning Committee's recommendations 
on the subject: 

Let me say, incidentally, that the Tyler Committee 
recommended, with respect to federal relations, 
in Its concluding statement, that It 'strongly 
reaffirms what has been the past policy of AERA, 
namely, that the Association as an organization 
should not attempt to speak for the field or 
attempt to influence government policies.' 
(Good lad Colloquium, p. 326.) 

From this statemtnt it is apparent that as recently as two years earlier, 
the AERA Planning Committee had concluded that AERA should continue Its 
past policy of not attempting to influence government policies . 

The question at this juncture is, did AERA continue Its "hands off" 
policy with regard to political influence or did the Goodlad Planning Committee 
reverse previous AERA policy and recommend efforts to Influence federal research 
policy? 
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The Planning Committee made five suggestions (a different, and 
weaker, mode than their earlier recommendations ) on the subject of what they 
termed "Relations to the Political/Social context." These suggestions were: 

1. That the AERA work collaboratively with other groups 

in an effort to strengthen public and Congressional support 
for educational research. 

2. That the AERA provide for thorough, quick review of 
educational projects financed by the Federal government. 

i 

3. That the AERA form a continuing series of ad hoc 
coimittees addressing themselves to educational policy 
issues which could be inuminated by research processes 
and findings.'- (To my knowledge there were none in 
operation at the trme.) 

A. That the AERA serve as a kind of clearing house for 
the indentif ication of i ndividual s wi 11 i ng and able to 
provide expert testimony before Congress on various 
educational problems and issues. 

5. That the AERA create a standing committee both to examine 
federal policy for education and to provide the membership 
with relevant data on federal and other commitments to educational 
research. (Planning Report, p. 22.) 

All five of these suggestions directly contras t wi th the previous AERA 
£os_mon, Since they all involve efforts to influence government research 
policy. The committee of two years earlier had concluded the opposite, that 
AERA should not try to influence government research policy. In addition, 
the last suggestion recognizes the importance of federal policy for AERA 
members, in that it calls upon AERA to transmit Information about federal 
affairs to the membership. 

How can we understand this dramatic shift in AERA policy in such a 
short time? At least three major factors in this situation differ from 
those in the earlier case. The people on the Planning Committee, the historical 
£2Ili£^. and the social science papers all represented changes from the previous 
Instance. Any one or all three might account for the reversal of policy. -If 
we are willing to assume that social science may have had some influence, how 
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^ does it appear that this Influence may have occurred? The sociologists 

presented their observations about how other fields had much more Influence 

on federal policy than did AERA. This idea had been repeatedly advanced by the 

AERA Executive Officer. One Planning Committee member recalled: 

(We discussed) how AERA could become (a more) visible 

spokesman for educational research, especially with Congress. 

Here (the executive officer) was influential with his 

thinking. (He indicated that) for example, AAAS, AMA, etc. all would 

be consulted by (federal agencies and/pr Congress), but AERA 

isn^t. There weren't any visible alternatives to AERA 

(in the way of organizations that might influence federal educational 

policy). (McLean ir^terview.) 

Thus, evidence about AERA's relative lack of impact on federal policy was 

remembered as influential by a Planning Committee member. 

In two papers, sociologists also speculated that the lack of politica^l 

influence might be due to others* refusal to accept the legitimacy of 

educational researchers' authority and to the relative lack of power of 

educational researchers vis a vis school administrators. While these 

theoretical strands were not picked up directly, they, in combination with 

the observations about other fields, may have made the Idea of greater 

Involvement with federal policy more sal lent for policy makers than It 

would have been otherwise. This interpretation was suggested by an Interview 

with another Planning Committee member. Shutz felf that the recommendation 

to start a ^'special pol it ical -type organization'* was directly Influenced by 

the Col loquium: 

'People were aware before (of the importance of 
Federal policies) but the Colloquium may have made more 
converts to the point o"" view of AERA doing more in the . 
area. * (Shutz interview.) 

This policy maker's use of the word "converts" suggests that the locus 

of change here was one of attitude or opinion rather than a question of 

factual Information. As he says, everyone already knew the federal government 
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was fmportant. What changed was their opinion about what their relationship 

with federal policy should be. By suggesting what other associations were 

doing in relation to the government and by acknowledging the importance of political 

power in the policy process, sociologists may have made the idea of AERA's 

Involvement more acceptable. It is possible that in this instance the ideas 

of sociologists may have served to create a climate of greater acceptance 

for an idea. 
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^ Chapter k 

IMPLEMENTATION 

This chapter examines the varying extent to which ideas presented . 
at the Colloquium were implemented by policy-makers. As already noted, 
the AERA Council's coiwnitment to implement any recommendations contained fn the 
Planning Report was hampered by the apparent draft nature of that report. Nonetheless, 
the Council did initiate deliberate and visible efforts to implement several of the 
major recommendations. 

One especially interesting programmatic change, however, grew not 
froin any particular recommendation but from the general impact of the Colloquium: 
this was a new stress by the AERA Council on the Importance of organizational self- 
study. Prior to the Colloquium, AERA had very little data on its membership. 
Journal readership, and annual meeting attendance. Garvey's paper in particular, 
showing that 256 AERA convention papers had been submitted to 6? different Journals > 
seemed to have a dramatic effect of surprise on the council members and planning 
committee. Realizing that there were important aspects of their operation on 
which they had little or no information, they concluded that institutionalized 
empirical social research could be of cons iderabl e worth . As a result, the 
executive officer commissioned me in 1971 to do a small survey of current 
and former members with respect to their interests, work, need for the 
Association, etc. » and in 1972 hired a half-time staff researcher to study 
broader aspects of AERA operations. 

The foregoing example Illustrates how a dramatic effect the demonstration 
of Information gaps within the AERP — boosted an idea toward Implementation 
even though it required additional funds. In contrast, the fate of the 
publications recommendations illustrates the more frequent Instance of implementation 
constrained by financial considerations. 1 
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Recornmendatlons addressing the issue of quality control suggested raising the 
editorial standards for journals, but did not specify whether new journals should 
be started or the policy should be applied to existing journals. While 
It would be more dramatic to Institute a new journal with tough standards 
and policies, practical concerns limited AERA to the option of chancing 
existing journals. These factors, In combination with the existing interest 
of one AERA Council member in having AERA produce a critical review, moved 
the association in the direction of changing the policy of an existing 
journal. The Review of Educational Research was already being published, so 
all that was required was to change the operating policy of that journal. 
While this step required consensus on the Council and the Publications 
Committee of AERA, It did not Involve the Finance Convnittee, since additional 
funds were not needed. 

Similarly, the Planning Committee recommendation that AERA facilitate 
communication within the association could be Implemented by changing the 
content and format of another existing publication, the Educational Researcher . 
Changes In both of these journals were Implemented within a year after the 
Planning Report was considered. 

In contrast, the Publications Committee's 1970 recommendation 
that the AERA institute a new journal In the social sciences, which would 
seek articles with original quantitative data and also articles by historians 
and philosophers of education, has not yet been Implemented as of January, 
1974. A major obstacle has undoubtedly been cost. Given apparent difficulties 
In overcoming this obstacle, the AERA has made efforts to widen the coverage 
of the American Educational Research Journal , Formerly devoted almost 
exclusively to educational psychology, It now Includes articles from other 
social sciences, especially sociology. 
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I These examples suggest that the course of implementation may 

depend, not surprisingly, upon financial constraints and upon the existence 
of already op^srating vehicles or mechanisms which can be modified to conform 
to a new policy more easily than a new vehicle can be started from scratch. 
Of course, if ah organization does not already have the njedium to change 
or the r'-3S0iirc.as to implement a recommendation, it may be able to Interest 
som c>..ti; d:> fj/O'jp 'n implementing certain ideas. This occurred when Peacocl* 
pubilsivr'i r,:i?-'ad to publish the recommended critical annual review of educational 
research. 

I-.- 

Jjs iitrj^tra] the Colloquium and Planning Report did not address the 
question of ?:.;.•/ recommendations might be implemented. The consequences of 
this lack were apparent in the area of Federal relations. 

As p^2viously noted, the Colloquium reinforced, a:id among some 
groups In f^ct created, the climate of support for AEIV. extension In 
federal activities. After the Planning Report supported the Idea, AERA 
Initiated a series of efforts to expand its influence in federal policy- 
making. The executive officer formed a group of "federal advisors" including 
a former Commissioner of Education, high-level HEW officials, and a scholar 
of the politics of education. Further, AERA held several dinner meetings 
for Congressmen and their aides, so they could meet prominent researchers In 
education and discuss new developments; they sent' letters to their membership 
urging them to support Representative John Brademas from Indiana, who was 
a strong advocate of funds for research on education; and they made numerous 
efforts to develop relationships with high-level Office of Education personnel. 
In an effort to influence the selection of staff and research priorities. 
After three years of such activity, AERA leaders still felt that they were 
Ineffective and that the "top leadership of OE has failed to respond to 
repeated offers from AERA officers and committees that might have produced 
^ the kind of symbiotic relationship with outside associations that have 
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supported programs for the handicapped, in guidance, and in vocational 
education.'' ( Educational Researcher , March, 1972.) At that time the association 
decided to pull back and focus on training, publications and meetings. Thus, 
while the Colloquium may have helped to change AERA's desire for involvement. 
It could not change the environment's response. By not addressing the 
Issue of how AERA might implement a policy of greater involvement In 
federal relations, the Colloquium and Planning Report contributed nothing to 
the success of those efforts. 

On a more general level, the Colloquijm may have led AERA to develop 
a somewhat different style for operating the association. Af ter^ the Council 
had spent ten hours of the two day Council meeting d'scussing the Planning 
Committee's interim report, Dershimer observed that the emphasis In the 
association had moved away from the Planning Committee method of change, 
toward a tendency to work for changes and long-range planning within 
existing AERA committees. Most organizations at least acknowledge the idea 
of developing internal mechanisms for innovation. Whether AERA has succeeded 
In doing this remains to be seen over time. 

Throughout the Colloquium and Planning Committee report, recommendations 
were presented in terms of what the association should do, but scant heed 
was paid to how it might Implement the recommendations. In one Instance 
described here, the data were so dramatic, and the need may have been so 
Strongly felt, that the AERA marshalled additional resources to conduct 
Studies of their membership ani operations. In the case of publications 
recommendations, implementation could occur by changing the policies of 
existing publications or by interesting an Independent publisher. In both 
examples, the principle difficulty in implementation v/as financial. Once the 
financial means were found, the ideas could be implemented. 
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In the case of recommendations dealing with federal relations, 
however, the practical difficulties involved in implementation went beyond 
financial problems. The AERA faced problems of political sfategy and influence 
with little or no prior experience and with no guidance from the Colloquium 
or the planning report. 
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Chapter 5 
SUMMARY AND CONCLUSIONS 
When Richard Dershlmer became the Executive Officer of AERA In 196^1 
he faced two kinds of problems. First, he confronted informational problems 
with respect to learning who the statesmer; of educational research were and 
what It Is that a community of scholars does for its pearticipants. He 
also became Increasingly aware of what might be called a political problem 
of organization. The relative importance and influence of AERA was much 
lower than It might have been. This was evident, he reports, in the fact that 
most of distinguished educational scholars named to the National Academy 
of Education (NAE) In 196^ were not members of AERA. Furthermore, AERA 
was not influencing federal policy on educational research at any level 
executive, congressional, or agency. His own reading in the sociology of 
science convinced him that perhaps social science theory and research 
might help AERA solve its problems. 

In conjunction with the Incoming AERA president, John Goodlad, 
Dershlmer developed the plan for the Colloquium of scholars and 
pol Icy-makers ; for which papers would be prepared in advance. He decided 
whom to ask to wrlte^papers by consulting people he knew. The result was 
a collection of people interested in a problem that was somehow relevant 
to the concerns of AERA. With one exception, however, the paper-writers 
were not Instructed to search for specific information or to deal wl th a 
particular topic. Instead, they were told to write a paper on a topic or 
problem that Interested them, on the assumption that whatever they were doing 
might i3e hsSpful to AERA. 

The authors of the Colloquium collected information In various ways. 
As already noted, only two gathered new data for the papers, although a third 
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author conducted secondary analysis of some existing data. The last two 
were primarily conceptual papers. 

The papers were prepared and distributed to participants prior to 
the Colloquium. Since Corwin's paper was very long (56 pages), he and 
Setder wrote a 27 page overview, which was circulated in advance. Hagstrom 
distributed his paper at the beginning of the Colloquium. It Is not clear 
that all participants had read the papers befpre the Colloquium, which meant 
that authors who effectively introduced ideas from or sucnmarized their 
papers during the Colloquium may have been more widely considered than 
authors who did not. 

Chapter 3 discusses In detail the way social science wes utilized 
by the Planning Committee in formulating the policy recommendations. There 
were at least three forms in which social science was used: social concepts 
or theories, empirical data, snd finally, the presence of social sclenrists 
as planners. Certain concepts were introduced in the Colloquium as relevant 
to the problems of AERA- The importance of the reward system in scientific 
fields was brought into the discussion by Storer, and was picked up by a 
sociologist on the Planning Committee who drafted the recoirimendat ion for the 
Fellows membership category in AERA. Storer also implied some causal relations 
between the reward system, the desire of individuals to join AERA and publish 
In Its journals, and the quality of research in education. 

There are several Instances of the influence of new empirical data 
on policy recommendat lens . Not only did Garvey formulate many specific 
suggestions at the Colloquium on the basis of his empirical data, but, as 
already noted, his empirical studies demonstrated the value of research on 
the actual operations of AERA. In addition, Corwin's reports of interviews 
with sociologists of science served to focus considerable attention at the 
Colloquium and in the Plannincj Report upon the quality of research as a 
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key problem. Further, Corwfn's observations about the role of profess Jonal 
association members In federal science policy-making may have served to 
provide a dra',natlc contrast for AERA planners when they considered their 
own situation. 

As already noted, the Importance of social scientists as planners 
cannot be underestimated, particularly with regard to making recommendations 
on the basis of social concepts of implicit causal models. The case studied 
here suggests that social concepts or orientations are much more likely to 
be brought to bear in decision-making when at least one of the important 
decision makers is a social scientist. Moreover, when a number of social 
scientists concur, as for example in the case of Corwin's reports about the 
role of natural scientists in influencing federal science policy, their » 
riK>re activist orientation may begin to prevail. • 
Social science would interact in various ways with policy makers. 
For example, social science could reinforce and strengthen existing ideas 
held by a policy-maker, as was suggested In the way Gage's idea for a ♦ 
critical review of educational research was supported by the Colloquium. 
By way of contrast, some Ideas advanced at the Colloquium or In the 
Planning Report were not adopted by the AERA Council. Recisons for this Include 
possibility that their consequences were too hard to fathom or were considered 
too far reaching; that not enough data were available, or that th^ Implicit 
causal models were not assumed. The Fellows recommendation formulated by 
a sociologist on the Planning Committee on the basis of assumptions about 
the nature and operation of the reward system in scientific fields Is an • 
example of ideas not accepted. 

Similarly, regarding both recommendations and implementation, there 
are widely differing degrees of overlap in ideas from the Colloquium and in 
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the recomrjendations, which underscores the Importance of the receivers of the 
soda! science Ideas for the transfer process. If social scientists are 
givers as well as receivers of the Ideas, the chances of their being accepted 
seems to be greater. 

Finally, with respect to both uti 1 Izatlon and Implementation, this 
case study reveals the Importance of at least a translator or an advocate 
of particular Ideas, particularly If giver anfl receiver do not share the 
same genera! orientations. For example, as a result of his own reading and 
thinking ]n the sociology of science, the executive officer of AERA become 
very famllar with many of the ideas presented in the Colloquium. He was 
the single greatest Interpreter of ideas between the Colloquium, the 
Planning Committee, and the Council. At the Council meetings, I observed, 
he summarized, some of the major themes of the CSlloquium for the members, 

The case of an idea which was not accepted by the Council, the Feilows 
recommendation, illustrates what happened to an Idea that had no advocate. 
No one from the Planning Committee attended the Council meeting when the 
proposal was considered. While Dershlmer was quite willing to interpret , 
sociology of science ideas for the Council, apparently he felt that since this 
proposal so intimately concerned the AERA membership and the structure 
of the organization as it affected members, he should not speak for or 
against the recommendation, but should let it be decided by the members' 
elected representatives. But because no one was there to present the Planning 
Committee's rationale for the proposal, the Council was unwilling to approve 
the Idea without understanding the basis on which it stood. 

The AERA asked me to evaluate the Colloquium* to fulfill their contract 
with the U.S. Office of Education, which had supported the it. 



Caroline H.Persell, "An Evaluation of a Strategy for Bringing Social Science 
to bear on Organizational Decision-making." Bureau of. Applied Social Research, Columbia 
University, New York, NY, April, 1970. wiuinuie 

CD?r^ 68 



Page 63 

After tracing the congruences between Ideas presented In the Colloquium, 
the Planning Report, and the Council's actions, I concluded that the 
Col loqulum's worth could be seen In terms of specific Ideas that were 
adopted by the Association, and also In terrns of the questions and problems 
It raised for AERA. I conclude that AERA policy-makers were faced with data 
and dilemmas that they had previously not had to confront to dlr5>ctly. The 
result was a sharpening of their awareness of the issues facing the Association. 
This result was particularly evident in the attitude of the Executive 
Officer, observed both by me and by a member of the Planning Committee, He 
said, ''the Colloquium had powerful effects on the Executive Officer of AERA, 
mobilizing and energizing it." This conclusion suggests a final way that 
social science may have been utilized to provide new motivation to fhose 
asked to carry out the activities of an organization. 
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